Amendments to the Sp ecification: 

Please replace the original specification with the attached substitute 
specification is attached along with a marked-up copy. 



Amendments to the Abstract : 

Please replace the original abstract with the following abstract of the 
disclosure: 

Abstract nf The Disclosure 

A radio line is easily influenced in its nature by attenuation or reflection of an 
electromagnetic wave or the like and the_surrounding environment. Due to this fact, 
a variation of the data transfer speed frequently occurs at the time of image 
streaming so as to become a hindrance ©^to reproduction of an_image at the 
receiving terminal. The-A distribution server is provided with meafiS-ajBultlplexeLfor 
multiplexing information indicating the transmission start time for the image data and 
switchino unit for switching an image bit rate in response to a request from 
the receiving terminal. The receiving terminal io provid e d with mcanc for u d n g uses 
information indicating a transmission start time for the image data, mefiltomg 
monitors t he receiving bit rate and mfeFmmg-sends out a the^request for transmission 
of the most-suitable image bit rate in response to^te^esu tt a comparison thereof . 
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Amendments to the Claims: 

This listing of claims will replace all prior versions, and listings, of claims in the 

application: 
Listing of Claims : 

1 . (currently amended) A distribution server comprising: 

an Input unit for Image data; 

an image data re-construction unit; 

a communication unit connected to a terminal; and 

a monitoring trigger information generating unit for generating a-monitoring 
trigger information that -with which said terminal performs a-receiving bit rate 
monitoring, wherein 

said monitoring trigger information generating unit inserts the-a_generated 
monitoring trigger into image data Inputted through said input unit and outputs it to 
tj ^said terminal through said communication unit. 

2. (previously presented) The distribution server according to claim 1 , further 
comprising a bit rate switching control unit for feeding said Image data to said 
terminal, and when said communication unit receives an image bit rate request 
command from said receiving terminal, said image re-construction unit switches the 
image bit rate to an Image bit rate specified by said command to deliver the image 
data. 

3. (currently amended) The distribution server according to claim 2, wherein as sale 
monitoring trigger, a transmission start time for a data f ragment to be transmitted 
next is Inserted into an extension part of said Image data to be distributed. 



3 



4. (currently amended) The distribution server according to claim 3. wherein as said 
monitoring trigger, a transmission start time for a data.fragment to be transmitted | 
next is inserted into an extension part of said Image data to be distributed. 

5. (currently amended) A terminal device comprising: 

a communication unit connected to a distribution server; 
a reproducing unit for a -reoroducinq received image data; and 
a monitoring unit for monitoring a receiving bit rate of said received image 
data; and 

an analysis unit for analvzinq said received image data, wherein 
said analysis unit extracts a monitoring trigger from said Image data, 
said monitoring unit performs saicl-monltoring through utilization of said 

monitoring trigger, and 

said monitoring unit feeds the-dlstrlbutlon bit rate switching Information of said 

image data through said communication unit in response to said receiving bit rate to 

be monitored. 

6. (currently amended) The terminal device according to claim 5, further comprising 
a timer for counting time, wherein 

said monitoring unit compares the time of said timer with a receiving start time 
of a next data f ragment specified by said monitoring trigger and starts said 
monitoring of the receiving bit rate from said time. 

7. (previously presented) The terminal device according to claim 6, wherein 

said monitoring unit compares a measured receiving bit rate with a bit rate 
switching condition recorded in a recording unit and feeds said bit rate switching 
information in response to a result of said comparison. 

8. (previously presented) The terminal device according to claim 6, wherein 
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said monitoring unit monitors a residual amount of said received image data 
stored at a recording unit, compares It with a bit rate switching condition recorded in 
a recording unit and feeds said bit rate switching Information in response to a result 
of said comparison. 

9. (previously presented) The terminal device according to claim 6, further 
comprising a decoder for decoding said received Image data, wherein 

said monitoring unit monitors a frame rate of said decoder, compares it with a 
bit rate switching condition recorded in a recording unit and feeds said bit rate 
switching information in response to a result of said comparison. 

10. (previously presented) The terminal device according to claim 6, wherein 

said monitoring unit monitors a time stamp included in said received image 
data, compares It with a bit rate switching condition recorded in a recording unit and 
feeds said bit rate switching information in response to a result of said comparison. 

1 1 . (currently amended) The terminal device according to claim 6, wherein 

said monitoring unit starts a-monitoring from a receiving start time of a next 
data f ragment received te-be-as specified by said monitoring trigger, finishes said 
monitoring upon completion of rQcoivina t he receipt of data of a_fragment size 
specified in said image data and calculates a receiving bit rate. 

12. (currently amended) The terminal device according to claim 7, wherein 

said monitoring unit starts a-monitoring from a receiving start time of a next 
fragment received t©-be-as_specifled by said monitoring trigger, finishes said 
monitoring upon completion of roco i v i na the receipt of data of a_fragment size 
specified in said image data and calculates a receiving bit rate. 
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13. (previously presented) The terminal device according to claim 6, further 
comprising a display unit for displaying said received image data; and an input 
instruction unit for receiving an input from a user, wherein 

an instruction for changing a bit rate through said input instruction unit In 
regard to the image data displayed at said display unit is received and said 
instruction is fed as said switching information. 
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REMARKS 

The specification has been amended to correct errors of a typographical and 
grammatical nature. Due to the number of corrections thereto, applicants submit 
herewith a Substitute Specification, along with a marked-up copy of the original 
specification for the Examiner's convenience. The substitute specification includes 
the changes as shown in the marked-up copy and includes no new matter. 
Therefore, entry of the Substitute Specification is respectfully requested. 

The claims and abstract have also been amended to more clearly describe 
the features of the present invention. 

Entry of the preliminary amendments and examination of the application Is 
respectfully requested. 

To the extent necessary, applicants petition for an extension of time under 37 
CFR 1 .1 36. Please charge any shortage In the fees due in connection with the filing 
of this paper. Including extension of time fees, to the deposit account of Antonelli, 
Terry, Stout & Kraus, LLP, Deposit Account No. 01-2135 (Case: 501 .43083X00), 
and please credit any excess fees to such deposit account. 

Respectfully submitted, 

ANTONELLI. TERRY, STOUT & KRAUS, LLP 




Carl I. Brundidge 
Registration No. 29,621 

DRA/CIB/jla 
(703)312-6600 
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SPECIFICATION 
TITLE OF THE INVENTION 

DATA DISTRIBUTION SERVER Al^D TERMINAL APPARATUS 

FIELD OF THE INVENTION 

This invention relates to an apparatus for switching 
^bit rate of a distributed image in response to a result 



of monitoring ^ a received statei at a mobile terminal and 
a method switching Efe-j^in an image distribution system 

in which 9. streaming is carried out for the coded image data 
from the distribution server toward the mobile terminal 
through a ^ertrtej^ circuit . 



BACKGROUND OF THE INVENTION 

In recent years , « rapid development of » broadband 

technology iml^fi iirnriniijnti nn of a mobile terminal^ such as 

a mobile phone or PDA (Personal Digital Assistance) or the 

like, have expanded Ss- image streaming services under an 

J \ 
application of radio^inf ra-structures , such as a cellular 
A ^ 

phone communication network or radio LAN (Local Area 
Network) and the like. A problem found in 1sbs image 
streaming servic^under application of fefae/ radio network 
consists in a variation of the electromagnetic wave 
receiving state. As the receiving state is varied, tiie^error 
in^eceiving operation frequently occurs, resulting in: 



Dri amount of data inogc 

li the;,transfer*a^ 

i^S55=5S5i-, of ^ 



Sj^re-transmissiori amount of data inogcaacd . ^Due to this 



influence^ there may occur a case in which the^transf eri«a^«^ 

rml" of the streaming data is varied and^* 

image cannot be executed accurately. In particular , it 

a^'h^ Jut«J VAi^ <K_ 

becomes a serious problerry^ how to j ^aooomroodcuto for case in 

which a state having a superior receivingj^ otate e is switched 

toward,^ ^ deteriorating Instate. tx;^/^oJ!iL --^ 



etnoc^ res 



The . prior art f or-g controllJ^Sti^ me thoc^ responding to 
tire j( electromagnetic wave receiving state in -fefeeyy image 
distribution system^ ^rovi -^tesj^ a method in which the 
receiving teirminal monitors the electromagnetic wave 
receiving state undor )^ a predet^onin^d^^ime interval in an 
electronic mail system.and then «]^ransmission .aasateie- of the 
mailn^distributed by the distribution server is changed in 
response to ^^sej^situation of change (for example, refer to 

the Patent Document 1) . jMjI ' o^**-*^ ^-''^^^^^ 

In addition, as the transmission methodj^ pcrf ogwcd 

1.1 1. jli I 111 moving image transmission device, there is also 

provided a method in which the receiving terminal always 

^ information indicating the receiving state to the 

distribution server to execute 1$ controlJftMifi^ over the data 

communication speed at the distribution server (for 

example, refer to the Patent Document 2) . 

Further, there is also provided a method for executing 

ft controUBfttt^ over the data communication speed in which 

A 
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data communication speed. is estimated at a mobile receiving 
terminal in reference to the electromagnetic wave receiving 
state and the content of the distributed image (sports and 
news or the like) and the result of estimation is i "nf orme d ^ 
to the distribution server (for example, refer to the Patent 
Documerit 3) . . 

[Patent Document 1] JP-A No. 349808/2000 
[Patent Document 2] JP-A No. 69483/2001 
[Patent Document 3] JP-A No. 344560/2000 

SUMMARY OF THE INVENTION 



The methods j^in the Patent Documents 1 and 3 

described above are carried o.ut^ such ;»,that the 

received state is monitored through observation of 
*^ 

15 intensity of ^electromagnetic wave at the receiving 
terminal. However, in the case fefe^j many receiving 
terminals are concen^ated atacer^tain one base center and 
the like , -fefeg S^OLaxilLjII^^ ^ometimesj^^that a 1 C-la Liuii Pu Hii;L.L.n the 
intensity of ^electromagnetic wave and the data 

20 communication speed a=sj^not necessarily proportionate to 
each other. Thus, in the case of this method, it is not 
possible to attain a complete holding of the received state 
at the terminal unit. 

The method described in the Patent Document 2 is 

25 carried out such that the receiving terminal unit always 



continues to transmit information concerning the received 
state agaicLa:^ the distribution server in order to cause the 
distribution server to judge the received state at the 
receiving terminal unit. Due to this fact, the receiving 
terminal unit must always execute both transmission and 
^ goociving at the time of image streaming operation, 
resulting in^that this method produces a problem^that «j|line 



available efficiency is reduced^ and^ at the same time 
processing load at the receiving terminal unit is increased. 

This invention is provided to solve the aforesaid 
problens^nd it is an object of this invention to provide 
means having a fungticm for Cciusing the receiving terminal 
itself to monitor accurately ithe receiving bit rate at the 
time ofj^image streaming operation aaadj^capable of executing 
a stable image streaming by requesting the distribution 
server to switch the receiving bit rate to the^ost-suitable 
image bit rate in response to the result ofyjmonitoring 
operation. 

The distribution server in an image distribution 
system using a radio infra-structure has means for 
multiplexing information indicating an image data 
transmission start time in the image data to be distributed, 
and means for switching the image bit rate in response to 
a request from ttes;^ receiving terminal. In addition, the 
receiving terminal unit is provided with means for 



monitoring the receiving bit rate through utilization of 
inforihatioh indicating the image data transmission start 
time and for informi -Rgjia transmission request for the most 
suitable Image bit rate to the distribution server in 
response to a result of j|monitoring. 



BRIEF DESCRIPTION OF THE DRAWINGS 

■ Fig . iyy shows -^^configuration of a receiving terminal 

unit; ^ M 

Fig. 2nshows «vconfiguratl^of a distribution server ; 



Fig. 2nshows «vconfiguratI^ c 



Fi<^. ci^uUi.ii rr ir , configuration of «ii image data; 
Fi^. ^ g-hnCTWTfe=»=BL stJ;ucture of "uuid" ; 

FigT 5/^shows a concept of generating "uuid" storing 
a monitoring trigger information; 

Fig. 6 is a time chart of a receiving bit rate 
monitoring; J " I 

Fig. 7 1^ shows a relation between a data transferring 
time in an image data distribution and a bit rate; 

Fig. 8 shows one example, of an image bit rate table; 

Fig. 9 shows one example of an image bit rate switching 
point table; i .i 

Fig. lOj^shows a form of use of an image bit rate table 
and an image bit rate switching point table; 

Fig. 11;\ shows one example of an image bit. rate 
switching operation for an upper level mode; 



Fig. 12|ysh.aws one example of an image bit. rate 



switching operation for an upper level mode; 

Fig. 13j^ shows another example of an image bit rate 
switching operation for an upper level mode; 

Fig. 14j| shows another example of an image bit rate 
switching operation for a lower level mode.; 

Fig. 15 is a flow chart for showing an operation of 
a distribution server; 

Fig. 16 is a flow chart for showing a processing of 
multiplexing "uuid" storing the monitoring trigger 
information to the distribution image da ^a ^^^^^^^^^^ 

Fig: 17 is a flow chart for showing an GntiE < ^ operation 
of a receiving terminal unit; 

Fig. 18 is a flow chart for showing a receiving bit 
rate controlling procedure; 

Fig. 19 is a flow chart for showing a receiving bit 
rate controlling procedure using an ascending switching 
sensitivity and a descending switching sensitivity; 

Fig. 20 is a flow chart for showing a procedure for 
measuring the receiving bit rate; , 

Fig. 21^ shows one example of a practical form^^using 
a distribution server and a receiving terminal; 

Fig. 22|^shows an example of a typical practical form^ 
using a distribution server and a receiving terminal unit; 
and 



Fig. 23^shows one example of a user-interface of the 

receiving terminal.. 

•DETAILED DESCRIPTION OF THE. PREFERRED EMBODIMENTS 

Referring now to the drawings, some preferred 
embodiments of an image distribution apparatus and an image 
receiving method in accordance with the present invention 
will be described 



Fig. 1 shows ag^conf iguration of a receiving terminal 
unit 100 of the present invention. 

Ima^data received by the receiving terminal unit 100 
is -ft data i^compressed by a predetermined coding system^ such 
as MPEG or the like^and the image data is distributed from 
a distribution server 200 to the receiving terminal 100 
through a radio communication network 112 and a i — 1 n-^^'^-nitnr 
113. 

The radio communication unit 101 transmits and 
receives data through radio communication with » 

A 

distribution server 200. An image data receiving unit 102 
receives data transmitted from the distribution server 200. 
The received image data is stored in a memory unit 104 
through an analysis unit 103. The analysis unit 103 performs 
an extraction to extract monitoring trigger information 
included in the image data, and infr i irm'. it ^ to a monitoring 

^'feb. 

trigger control unit 109 and ; 



image data to a receiving bit rate monitoring unit 110. The 
monitoring trigger information is ■ jnoai'it by information 
indicating a time in which the receiving bit rate-monitoring 

unit 110 starts a monitoring operation, or information 
becoming a trigger in which the receiving bit 
rate-monitoring unit starts a monitoring operation. The 
memory unit 104 is used for temporarily storing the image 
data. A reproducing unit 105 reads out the image data in 
sequence from the memory unit 104 in o c quonde to perform «•» 
expansion processing, the moving image after expansion is 
displayed at a monitor 106 and its audio signal is outputted 
at a speaker 107. Further, in the case Ul'nii"t|y the received 
image data is enciphered, the reproducing unit 105 is 
provided with a decoder^to perform a decoding operation. It 
is of course apparent that when the image data is not 
enciphered, this decoder is not (s^S'^rs e A: ,i n 1 iIht^' needed. A 
reference timer 10 8 is a timor becoming reference for «. 
synchronous reproduction for both^moving image andj^audio. 
In addition, the reference timer 108 is also used forj^a 
comparison at the monitoring trigger control unit 109 with 
a time included in the monitoring trigger information. The 
monitoring trigger control unit 109 compares a time at the 
reference timer 108 with a time indicated in the moni^^^ng 
trigger information, and when they coincide^ ^^each 

other, this monitoring trigger control unit 109 applies a 



trigger for starting the monitoring operation againot ji the 
receiving bit rate-monitoring unit 110. The receiving bit 
rate-monitoring unit 110 performs a monitoring operation 
'"-fej^the received bit rate from a time in which the 



trigger is applied from the monitoring trigger control unit 
109. In the case thcy t^^a result of monitoring is displaced 
out of a predetermined bit rate range, a command 
transmission unit 111 requests an image data bit rate 
switchin^j^a^swrtse^j^^^the distribution server 200. When the 
result of jtmonitoring operation is in a predetermined bit 
rate range, it does not request a bit rate switching^^ againot 
the distribution server 200 . The command transmission unit 
transmits commands of a^distribution ata^feMa^ of image data,^ 
•fc. distribution -rt nrj of image data and an image bit rate 
switching request and the like againot i^the distribution 
server 200. . . 4^. 

Fig. 2 shows ^^configuration of the distribution 
server 200 of the present invention. 

Image data tr^jmitted through an external public 
network 2 lOj such as^§wi internet or the like^is received at 
the image data input unit 201 and stored at the memory unit 
202. The ^^erence timer 206 generates reproducing time 
inf ormationj^applied at the time of reproduction of the image 
data at the receiving terminal unit 100 and transmits it to 
the image data re-construction unit 203. A monitoring 



trigger information generating unit 207 refers to the time 

information of the reference timer 206, generates 

: Ms- 
monitoring trigger information j^used by the receiving bit . 

rate monitoring unit 110 of the receiving terminal unit 100 

and transmits it to the image data re-construction unit 203. 

The image data re-construction unit 203 multiplexes the 

reproduced time information Igfot j^trom the r^fer^nce timer 206 . 



and the monitoring trigger information -gcet^ from the 
monitoring trigger information-generating unit 207 on the 
image data read out of the memory unit 202 . The image data 
transmission unit 204 transmits the multiplexed image data 
to the receiving terminal 100. As also shown in Fig. 1, the 
image data transmitted from the distribution server 200 is 
transmitted to the receiving terminal 100 through the radio 
communication network 112 and the relay ji oont or 113. The 
radio communication unit 205 performs a transmission and a 
> Boocin i Liny of data with the receiving terminal 100 through 
radio communication. The command receiving unit 208 ^ 
receives some commands^ such as *^distribution jjitai Liiiig , 
distribution i B - topp r a r «g and an image bit rate switching 
request and the like^sent from the receiving terminal 100. 
The bit rate switching control unit 209 performs a switching 
from the image bit rate during the present distribution 
operation to an image bit rate indicated in the command when 
the bit rate switching control unit 209 receives the image 



bit rate switching request coiranand from the receiving . 



Fig. 3 shows ffustructure of the image data. 

A rnrtieiiin rn^f^imig^ data" has a structure in which a 
plurality of fragments 300 are in a continuous form. The 
fraigraents 300 aro moant by ^a certain collected data unit in 
which the image data is divided by every predetermined 
reproduction time lengthy and control information retired 
for reproduction is aidded to each «S=5lse image data, -ft.time 
length applied as a ref erence|^^^ dividing operation can be 
optionally set^and it may al^so be applicable that each of 



them has a different lengthi,to each other. 



: length] 



Fig. 3A shows «^structure of one fragment 300. The 
fragment 300 is constituted by a row of telop characters 
15 optionally displayed in multiplex form on the reproduced 
image or the like, "uuid" (Universal Unique Identifier) 
(301) having additional information stored in it that a user 
can optionally define, a header 302 having information 
required for reproduction ^ such as random access control 
20 information and the like,\moving image of >(,predetermined 
r^roduction time length and aaj^^audio data 303. In the case 
ofj^example illustrated in this figure, although one "uuid" 
*> isy^lef t in the fragment, it ma y ^ ^^^als^ be applicable that a 
plurality of "uuid"s are pgopnrcdj|in response to the number 
25 of user defined information. In the case of the image 
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distribution method of the present invention, monitoring 
trigger information is stored in one of the "uuid"s.. The 
monitoring trigger information is used as a trigger for 
starting a measurement of the received bit rate. Data 



)f the rece 



transfer of one fragment is* a burst transfer (its details 
will be describedj^in ref ere nji^^^^to^JFi g. 7). The receiving 
terminal 100 can tenow accuratelyia burst transfer starting 
time i ^^ ef erence to the monitoring trigger inf ormation^to 
cause «j^measurement accuracy of the receiving bit rate to 
be improved. The monitoring trigger information is 
information regarding a transmission and^ r oaoiving of the 
image data*and this information has no0 direct relation with 



the reproduction ofj^image. Accordingly, it is desirable to 
insert it intoj^"uuid" ^i;m.ni g n tj^ ^o r ing optional inf ormation 
concerning the reproduction of image. In addition, "uuid" 
is operated through utilization of^ID assured that it is not 
overlapped in the system. The system not requiring any 
monitoring trigger information enables the monitoring 
trigger information to be ignored through discrimination of 
ID^and it has also. an effect to prevent any unintentional 
erroneous operation. It is of course ^^ arent that it can 
be inserted into header other thani"uuid". 

Fig. 3(B) shows « ((^structure having a plurality of 
fragments 300 connected to each other. An arrangement of 
the fragment 300 of the image data becomes a structure in 



j 



which the^f ragments are arranged f rom the leading one in sn^^ 
order of |reproducing time . In the case of the example shown . 
in this figure, the fragment (304) is reproduced at first 
and then the fragmentn+i (305) is reproduced.. As shown in 
5 Fig. 3(A) , the "uuid" (301) , the header (302) and the moving 
image and audio data (303) c<^stitT^e each of the fragments. 
Fig. 4 shows structure off^uuid" (301) . 
The "uuid" is f data that a user optionally can define, 
and the moving image and the audio data are separately added 
10 to the image data. As shown in Fig. 4 (A) , the "uuid" (301) 
is constituted by^ylt', size of the entire '^uuid" ,. a row of text 
characters (402) expressing "uuid", an identification ID 
(403) and a data unit (404) . In the case that the monitoring 
trigger information is stored in the "uuid" (301) , the 
15 trigger time information instructing a starting of the 
received bit rate monitoring operation at the receiving 
terminal 100 is stored at the data unit (404) . F iy . ia(D) 
^fegTO8=arcs=gs. amplo ul LLe ^^uuld" (301) j^Loring Lln^ moni L ui il HJ 
^ j.j.j;^ I II I .. I iiHitfH,mr . Fig. 4 (B) shows one example of the 
,20 "uuid" (301) having the monitoring trigger information 



stored in it. In the example shown in Fig. 4 (B)^ijj liidisia. Lud 
-tetee* the "uuid" size 405" ^asA28 bytes. The row of text 
characters (406) expressing the "uuid" is common 
irrespective^the type of "uuid" and the processing unit 
25 recognizes that this data is^"uuid" through the row of text 



characters. The identification ID (407) is a code for use 
in recognizing the type of "uuid". In the case of . shown 
in this figure, the identification ID (407) is a code 
indicating, that the row of characters 
5 expressing. "TRIGTIME-0000000." is ( monitoring trigger 

information, and the receiving terminal 100 detects the row 
of characters and recognizes the monitoring trigger 
information. "123456msec" stored at the final data/yis 
information expressing a trigger time at the receiving 

10, terminal ^°°J^J^4^ ifel 

Fig. 5 DhP!?n^J|Concept for generating|"uuid" storing 
the monitoring trigger information at the distribution 
server 200 . 

In this figure , j^"uuid" storing the monitoring trigger 
15 information is indicated as TRIGuuid. TRIGuuid (502) of a 
fragmentn (505)Jydistributed at a distribu^sn time TO (508) 
stores a^lanned time Tl (509) in which -etj^ next fragmentn+i 
(506) is idistributed. Similarly, TRIGuuid (503) of a 
fragmentn+i ( 506 )y^distributed at a distribution time Tl (509) 
20 s^^es a planned time T2 (510) in which a fragmentn+2 (507) 

is ^distributed, and TRIGuuid (504) of a fragment„+2 (b01)~AA^ 
distributed at a distribution time T2 (510) stores a planned 
time T3 (511)^n which a subsequent fragment is^distributed . 
In this way , ^TRIGuuid of the fragment at a certain 



distribution time stores without fail a distribution 
planned time f or^f ragment ^^distributed next. 

As another preferred embodiment, it is also 
applioablo j^that TRIGuuid stores a distribution-planned. time 
5 for either a header part or a moving image/audio data in the 
same fragment. In this case, althoiigh TRIGuuid is but of 
a target of a receiving bit rate measu ^ ment , this does not 
become a substantial problem because ilj^data size of TRIGuuid 
is quite small as compared with that of its subsequent moving 
10 image/audio data. 

As a further prefeirred embodiment, in the case fehat i^ 
the distribution server 200 and the receiving terminal 100 
store a transmitter of the same clock, it may also be 
app 1 i □ gb I'Cj^tha t TRIGu u^ stores a clock counter value to be 
15 distributed in place ofj^time information. The clock counter 
value may be a calculated clock value from the starting time 
or a relative clock value from a previous fragment 
distribution. 

Fig. 6 shows a time-chart for $ receiving bit rate 
,20 monitoring at the receiving terminal 100. 

Since data transfer of one fragment is carried out in 
a burst tran^^r, the data transfer is completed in a shorter 
time than ^ ^mage data reproducing time of that fragment. 
The receiving bit rate at the receiving terminal 100 is 
25 calculated through measurement of a time of this burst 



transfer segment and a received data size. For example, a, 
■processing at the time of | isefisftiwieg of /fragment at the 
receiving terminal 100 is carried out as shown in Fig. 6. 
At first, a fragment 1 (614) is. received (600) at a time TO 
(610) and then T^Gui^id having the monitoring trigger 
information storedlis analyzed (601) at the analysis unit 
(103) . This TRIGuuid stores ir^receiving time Tl (611) of 
a next fragment 2. A monitoring trigger control unit 109 
at the receiving terminal 100 performs a time comparing 
processing (602) with the reference timer 108 for a 
receiving time Tl (611) . The distribution server 200 starts 
a distribution of the fragment 2 (615) from a roaohing time 
of Tl (611) . The receiving terminal 100 performs a data 
receiving operation (605) of the fragment 2 (615) from a time 
Tl (611) and concurrently starts a measurement ofj^receiving 
bit rate at (603) . In addition, the header of the fragment 
2 (605) stores a data size of the fragment. This data size 
is read out and used for detection of a completion of the 
data receiving for the fragment 2 and a completion of 
measurement of the receiving bit rate. Also^at the time of 
data ^D^ ^lJing of the fragment 2 (615) and the fragment 3 
(616) after this operation, the processing is carried out 
in the order of the data TCQ(ivv^m^ /\ of fragment (605) , 
TRIGuuid analysis (606) , a timer operation of monitoring 



trigger (607) , a receiving bit rate, measurement (608) and 
a fragment size analysis (609). 

Fig. 7 shows a relation between a typical data 
transfer time and a bit rate at an image data distribution; 



As already been described ada j^ref erence to Fig. 6 , 
since the data transfer for one fragment is a burst transfer, 
the data transfer is completed in a shorter time tha:n an 
image data reproducing time for that fragment. Th^time for 
the data transfer is determined in reference to «^transfer 
frequency of a radio line. Upon receiving 4# the 
image data fragment having an image bit rate CBR (706) and 
an image reproducing time Ftsl second (707) at the receiving 
terminal 100, the data is received at a faster receiving bit 
rate RBR (705) than the image bit rate CBR (706) , so that 



an image reproducing time Ftsl sec. (707) . If it is assumed 
that aF;;size of each of the fragments (701, 702, 703) and the 
receiving bit rate RBR (705) are kept constant, 
fragment-receiving times (710, 711, 712) are also kept 
constant. However, actually, since the fragment size and 
the receiving bit rate are changed for every fragment, the 
fragment receiving time does not become a constant value as 
shown in Fig . 7 . 

Fig. 8 shows one example of an image bit rate table 

800. 





j|^of data is completed in a shorter Btsl sec. than 



. An image, bit rate table 800 is a table indicating the 
type of the image bit rate CBR (706) that the distribution 
server 200 can deliver. Both the distribution server 200 
and the receiving, terminal .1.00 use this table. 

In the example illustrated in the figure, thio ahowo 
sit is possible to deliver three kinds of image bit rates 



of 100 icbps, 200 kbps and 300 kbps . The numb er^ f image bit 
rates can be optionally set and the value of^^bit rate can 
also be optionally set. In order to identify the type of 
image bit rate CBR (706), the mode 801 is used. In this 
figure, the mode 0 (802) is 100 kbps, the mode 1 (803) is 
200 kbps and the mode 2 (804) is 300 kbps. 

In the case -fe^S^a plurality of bit rates are to be 
prepared for the same image, the amount of data to be 
distribu^d is changed an^the ^t rate is ^a nge(^^y 
Chang ing^image quality of J|image , ^quality of jiaudio image 
size and the displayed number of j^image per specified unit 
of the image and the like. The receiving bit rate-monitoring 
unit 110 at the receiving terminal 100 refers to the image 
bit rate table 800. This table may atoro ^a predetermined 

■TV 

exclusive memory.at the receiving terminal lOO^and ia atorcd 
sit a part of the memory unit 104. Additionally, the bit rate 
switching control unit 209 refers at the distribution server 
200. This table may be stored in a predetermined exclusive 



memory>in the same manner as that for the receiving terminal . 
100 awi^i^may be jL u-tu d " aU a part of the memory unit 202. 

Fig. 9 is a diagram £3S¥ showing one example of an image 
bit rate switching point table 9 00. 

The image bit rate switching point table 900 is a table 
used for performing a comparison with a received bit rate 
measured by the receiving bit rate-monitoring unit 110 of 
the receiving terminal 100 andjj^ef erred to j judge whether or 
not it isjj switched to another bit rate <igainot ^ the 
distribution server. The receiving terminal 100 uses this 
table and this is constituted by information of the upper 
limit bit rate UBR (901) and information of flower limit bit 
rate BBR (902) for every mode 903 of the image bit rate. The 
type of mode 9 03 is set such that it may coincide<| with 
the image bit rate table 800. The upper limit bit rate UBR 
(901) and the lower limit bit rate BBR (902) are set in 
response to a relation of performance between a fragment 
size distributed by the distribution server 200 and 
transfer frequency of the radio line to be used. In the 
example shown in this figure, thi^ 3ho%?o the pte no image bit 
rate switching is carried out if the receiving bit rate is 
between 1 . 8 Mbps and 2 . 2 Mbps during Ji p e e t rrv ii rf g of the mode 
1 (905) . In the case j^-y^spt the value is lower than 1.8 Mbps, 
it is switched over to the mode 0 (9 04)^ and^in turnjwhen the 
value exceeds 2.2 Mbps, it is switched over to the mode 2 
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(906) . If the receiving bit rate does not exceed 1. 2 Mbps 
during a state in which the mode 0 (904) is being received, 
this iiKWV^m^^^^at an image bit rate switching is not hfifj 
performed. If the rate exceeds 1.2 Mbps, ^^^is switched to 

5 the mode 1 (905) . In the example shown, the lower limit bit 
rate BBR 8902) is not set because -fei^e^image bit rate less 
than the mode 0 (904) is not present. If the receiving bit 
rate does not lower 2 . 8 Mbps du r i ng sj^^^te^in which the mode 
2 (9 06) is being received, this oitpr o o c o e j| that an image bit 

10 rate switching is not performed. If the value lowers 2.8 
Mbps, the mode is switched to mode 1 (905) . In the example 
shown in this figure, the upper limit bit rate UBR (901) is 
hot set because -feisey^image bit rate more than mode 2 (906) 
is not present. It is satisfactory to record information 

15 specifying a bit rate corresponding to each of the modes 

other than the specified valu^shown in Fig. 9. 

A 

The receiving bit rate monitoring unit 110 at the 
receiving terminal 100 refers to the image bit rate 
switching point table 900. The table may be stored in a 
20 predetermined exclusive memory at the receiving terminal 
100 or/^raay be stored partially at the memory unit 1Q4 . 

Fig. 10 shows a form of use of the image bit rate table 
800 and the image bit rate switching point table 900. 

Both the distribution server 200 and the receiving 
25 terminal 100 use the image bit rate table 800. The receiving 



terminal 1. (1001), and the receiving terminal 2 ( 1002) v-fcspt^ 
in a connected relation with a certain distribution server 
lOOO.have tables (1008, 1010) having the same content. as that 
of the image, bit rate table 1005 ewnod by/ ^the distribution 
server ^ ^ ^ ^ jj^^^^^"*^^^^ embodiment, ^"^^^ 

applicaJ i^'cthQtj,^ ri j^-t^g -H^-t-minai i nn^pp^rf ormlfc a direct 

transmission of data indicating the image bit rate value as 
a method for specifying the image bit rate to the 
distribution server 200, the distribution server 

reconstructs the image data in response to the specified 
image data. In this case, it may also bej^ applicable that 
the distribution server 200 does not use the image bit rate 
table 800. The receiving terminal 100 uses the image bit 
rate switching point table 900. It is necessary that the 
content in the table is prepared for every radio network so 
as to be dependent onl^ransfer frequency at the radio line. 
For example, the image bit rate switching point table 1009 
at the receiving terminal (1001) connected to the radio 
network 1 (1003) and the image bit rate switching point table 
1011 at the receiving terminal (1002) connected to the radio 
network 2 (1004) have different set contents for every mode. 

These two tables may also be set in advance at the 
distribution server 1000, the receiving terminal 1 (1001) 
and the receiving terminal 2 (1002). In addition, it may 
; also be A^^plie^e^hat the table corresponding to the radio 



network to be relayed is transmitted from the distribution 
server lOOG to the receiving terminals 1001, 1002 before 
starting distribution of the image data because the 
receiving terminal"»5^/on a different radio network. In 
5 the case of the radio network having a different data 

transfer performance, if the operation is applied without 
switching the table, "^^ight. become a cause for inducing 
an erroneous operation because the image switching 
point is different due to ^g^^^^^J^)-^^^'^^^®''*^ 
10 capability. Accordingly^!, f;^ the table -i i 1 i " ihI In he 

i III -1 at the time of^s tartlfil^W? of streaming and at the 

time of switching of the radio network, it might be possible 
to prevent the image bit rate switching from being 
erroneously performed. a-povjJ^ 
15 In this way, even if the receiving terminal 10.0 moTuto-c^ 

on %i*^radio network having a different data trans fer*!a«Af 
performance, the image bit rate switching can be applied 
through utilization of the most-suitable table to each of 
the radio lines . 
20 Fig. 11 shows one example of the image bit rate 

switching operation to an upper level mode. 

It is assumed that the receiving terminal 100 uses the 
image bit rate table 800 and the image bit rate switching 
point table 900 shown in Figs. 8 and 9 and the r eceiving 
25 terminal 100 receives the image data of mode 1. Arrange of 
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the receiving bit rate RBR (1104) for maintaining the image 
bit rate under the mode 1 is 1.8 Mbps to 2 . 2 Mbps . The image 
bit rate switching is not carried out because the receiving 
bit rate RBR (1104) at the receiving. 1 (1100) and the 

5 receiving 2 (1101) is 2.0 Mbps. The image bit rate swit^ing 
1105 from the mode 1 to the mode 2 is requested again-o t y^the 
distribution server 200 because the receiving bit rate RBR 
(1104) exceeds 2.2 Mbps at the time of receiving 3 (1102) . 
With this operation , the server switches the bit rate , and 

10 the terminal receives the image data of the mode 2 from the 
. receiving 4 (1103) . m/I 



As already -fees©^ describedj^-*« reference to Fig. 8, 
differences in image caused by a difference of the image bit 

rates before and after the mode switching operation are 
15 image quality, quality of audio, image size and the number 



of displays per predetermined unit of^^image and the like. 

Fig. 12 shows one example of an image bit rate 
switching operation to a lower level mode. 

It is assumed that the receiving terminal 100 is 

20 receiving «« image data of mode 1 under application of the 
image bit rate table 800 and the image bit rate switching 
point table 900 shown in Figs. 8 and 9 in the same manner 
as that shown in Fig. 11. The image bit rate switching is 
not carried out because the receiving bit rate RBR (1204) 

25 of the receiving 1 (1200) and the receiving 2 (1201) is 2.0 
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Mbps . The image bit rate switching 1205 is requested as^a**wrty^ 
the distribution server 200 from the mode 1 to the mode 0 
because the receiving bit rate RBR (1204) lowersj(1.8 Mbps 
at the time of receiving 3 (1202) . Thus, the image data of 
mode 0 is received from the receiving 4 (1203) . 

Fig. 13 shows another example of an image bit rate 
switching ope rati o n^^^o^ an upper level mode*^ 

In the case tfe^^the receiving bit rate is rapidly 

changed in a continuous manner, Jdae. image bit rate switching 

is frequently produced and becomes a load for the image data 

distribution. In this case, it may also be/iy appli ' oabl j thuL 

a controlling operation tr rimfrii"^^ nnt in such, a manner that 

a unit for discriminating an image bit rate switching has/^ 

certain sensitivity and the number of occurrenc^of 

A 

switching is reduced. 

ThiJ figure ^shows an example in which an ascending 
switching sensitivity uc-sensi (1307) is set in the case of 
switching to the upper level mode. The ascending switching 
sensitivity uc-sensi (1307) is a numerical value indicating 
that -lite image bit rate switching is requested at how many 
times it exceeds the receiving bit rate RBR (1305) in a 
continuous manner. For example, it is assumed that the 
ascending switching sensitivity uc-sensi (1307) is set to 
3 and -feiBe image data of mode 1 is being received. At the 
time of receiving 1 (1300) , the image bit rate switching is 



not carried but because the receiving bit. rate RBR (1305) 
is 2.0 Mbps. However, the image bit rate switching 1306 from 
the mode 1 to the mode 2 is requested aefainotj i^ the 
distribution server 200 because the receiving bit rate RBR 
(130 5) exceeds 2 . 0 Mbps by three times in a continuous manner 
at the receiving 2 (1301) , receiving 3 (1302) and receiving 
4 (1303) . The image data of mode 2 is received from the 
receiving 5 (1304) . The ascending switching sensitivity 
uc-sensi (1307) is held by the receiving bit rate monitoring 
unit 110 of the receiving terminal 100. The maximum value 
of the ascendi^^witching sensitivity uc-sensi (1307) is 
dependent on as. y(ac cumulated capacity of the image data at 
the memory unit 104. It is at least necessary that the same 
image data of^fragment as that of the number of times 
avoiding the image bit rate switching (i.e. a value of 
switching sensitivity) is always stored in the memory unit 
104 prior to the reproduction. It is possible that the 
ascending switching sensitivity uc-sensi (1307) can be 
automatically sgt by the receiving terminal 100 through 
: calculation of 'Sicapacity of the memory unit 104 and a mean 
value of data size of one fragment i^ attainod in response to 
the image bit rate. In addition, a user may also set it 
optionally . 

Fig. 14 shows another example of an image bit rate 
switching operation to a lower level mode. 



The image bit rate switching method used ;the ascending 
switching sensitivity shown in Fig. 13 may also be. 
applicable to an image bit rate switching operation to a . 
lower level. In this figure, it is assumed that the 
descending switching sensitivity dc-sensi (1407) is set 3. 
and tfafi. image data of mode 1 is being received. The image 
bit rate switching is not carried out at the time of 
receiving 1 (1400) because the receiving bit rate RBR (1405) 
is 2.0 Mbps. An image bit rate switching 1406 from mode 1 
to mode 0 is requested ai3a*«^the distribution^jerver 200 
because the receiving bit rate RBR (1405) lowers^LS Mbps 
continuously -by three times at the receiving 2 (1401), 
receiving 3 (1402) and receiving 4 (1403), respectively. 
The image data of mode 0 is received from the receiving 5 
(1404) . 

The descending switching sensitivity dc-sensi (1407) 
is held at the receiving bit rate monitoring unit 110 of the 
receiving terminal 100. In addition, a method for setting 
the descending switching sensitivity dc-sensi (1407) is 
► also similarly carried out in the same manner as that for 
the ascending switching sensitivity uc-sensi (1307) . 

Fig- 15 is a flow chart feea: showing an operation of 
the distribution server 2 0 0 • ^ ^^^j^--^ 

At first, it is ty.6 L iiur r7 i9 teg^ whether or not a» & 
5 operation of the distribution server 200 is stopped (1500) . 



In the case of continuing the operation, it is^di^uiiuiii-iat 
at (1501) whether or not thGrc io piuuidLd a command 



receiving operation from the receiving terminal 10C]|y. In the 
case of 3t<^ppirt g operation||, it i s ^ cLi a imi n a tod at (1512) 
whether or not the image data is being distributed at 
present, and if the distribution is being carried out, the 
distribution is stopped at (1513) and the processing is . 
finished. In the case^^^ a lucuI u ing » a # comraandjis present 
during continuation of |operation , the command is analyzed 



at (1502) and it is j ^jfocri^nQtod at (1503) whether or not 
it is a request for starting^distribution wi-^the image bit 
rate CBR. If this is a request for startingy^ distribution , 



it i-|^dicarimin.ntr-ri at (1504) whether or not the image data 
has already been distributed. If the image data has already 
been distributed, it ist dl o cr iminatcd at (1505) whether or 
not the image bitratej^eing distributed is the same as the 



requested image bit rate CBR. In the case -fefe^^ the image 
bit rate CBR is the same as the image bit rate, being 
distributed, the command is^i yr^re^ In the case -felwrt^they 
20 are different from each other, ;^«t is switched to the image 
bit rate CBR requested by the command and the distribution 
is started (1506) . If the command is not a request for 
startingkdistribution at the processing 1503, subsequently 
it is^^io criminated at^l508) whether or not the command is 
25 a request for stoppingi^distribution . If the command is a 



request for stopping/^distribution , it i sj^ d - i 3 c i" imi na t e d at 

(1509) whether or not the operation has already been stopped^' 

andwin turmif the operation is not stopped, distribution 
^ f ^ ^^^^ 

ofj^image data is stopped at (1510). In the case tba*^ the 

5 operation has already been stopped, the command is ignored. , 

. ■ . ^ 

In the case -tefeSFt^the command is not a request for stopping^ 

distribution at the processing 1508, an error processing is 

carried out at (1511) because the command cannot be 

recognized by the distribution server 200. As an example 

10 of the error processing, there is p rocont a processing or 

the like to inform the receiving terminal that the command 

is not effective- It may also be applicable^as a method in 

which the distribution server 200 switches the image bit 

rate^that a plurality of kinds of image data indicated in 

15 the image bit rate table SO^are all prepared in advance in 

an image data inputted f romJ^outside^and the image data with 

the image bit rate specified by the receiving terminal 100 

is selected out of them and distributed. In addition, in 

the case -tebrrt^the image data that the distribution server 

20 200 inputs f rom/\outside is one non-compressed image data, 

3^ image data converted by a predetermined method may also 

be distributed by changing some parameters^ such as the 

number of frames to be transmitted, for example, in such a 

manner that the image data ohowo Jan image bit rate specified 

25 by the receiving terminal 100- Further, in the case^ti 



■ the image, data inputted by the distribution server. 200 from^ 
outside is one compressed image data, the image data 
re-converted by a predetermined method may also be 
. distributed in such a manner that the bit rate may become 
5 an image bit rate specif ied by the receiving terminal 100. 

Fig. 16 is . a f low-chart7 Ioir indicat i ng t h n4 : the 
distribution server 200j^perf orms a multiplexing processing 
^^"^^^^^P^uld" having the monitoring trigger information 

stored in the distribution image data. 
10 At first, the image data is inputted from/outside 

. through the image data input unit 201 (1600) . Next, the 
fragment of the image bit rate GBR is extracted from the 
inputted image data through an image data re-construction 
unit 203 (1601) . Concurrently , a next fragment transmission 
15 starting time is set at "uuid" through a monitoring trigger^ 
information generating unit 207 (1602) . In the case tSS^-^ 
the fragment is constituted every certain specified time, 
a reference timer 206 is referred to and one fragment time 
is added from the transmission time of the fragment to be 
20 transmitted now/;to set a transmission starting time. In the 
case -^^the fragment time interval is not constant, a 
reproducing time for the fragment to be transmitted now is 
added to a transmission time of the fragment to be 
transmitted Ato set a transmission start time. The 
25 transmission start time is distributed to the receiving 
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terminal 100 through^ the image data transmission unit 204 
by multiplexing '^uuid"^to the extracted fragment through the 
image data re-cOnstructing unit 203 (1604) . * 

Fig. 17 is a flow chart showing in., iii rgg^operation 

5 of the receiving terminal 100. 

At first, a streaming of the image data is started 
(1700) to set the reference timer (1701) . During the 
streaming operation, -Wm receiving bit rate control is 
executed through the receiving bit rate monitoring unit 110 

10 (1702) in parallel with the rcociTiiring ^ (1700) of the image 
data through the image data receiving unit 102 and a 
reproducing operation (1704) through ^ a reproducing unit 
105. This operation is repeated until the streaming 
operation is completed (1705) . 

15 Fig. 18 is a flow chart -fes9f showing^ an order of the 

receiving bit rate controlling operationj^at the receiving 
terminal 100. 

At first, a moden of the required image data is set 
at the distribution server 200 (1800) . The image bit rate 

20 GBR is determined from the moden in reference to the image 
bit rate table 800. Next, the upper limit rate UBR and the 
lower limit bit rate BBR are ^^)^(1801) in reference to the 
image bit rate switching point table 900, and a distribution 
starting request command with the image bit rate ^Sji^is 

25 transmitted to the distribution server 200 (1802) . 



Subsequently, it is discriminated whether or not the 
streaming operation is finished (1803)j and^if the operation 
finished, the distribution stopping request command 



is transmitted to the distribution server to finish the 
processing (1814) . In the case -fefaa^the streaming operation 



is to be continued, the receiving bit rate RBR is measured , 
(1804) feu uumpLLiLL^the upper limit bit rate UBP/with the lower 
limit bit rate BBR (1805, 1806) . If the receiving bit rate 
RBR is in a range between the upper limit bit rate UBR and 
the lower limit bit rate BBR, the present . mode is tespt A 
(1807) . In the casej^-fefeept the mode isAkepi, a request command 



transmission is not carried out againat j^the distribution 
server 200. Also^in the casejilsisafe the distribution server 
^^^Jthe present mode in order to hold a recording of the 
received state of the receiving terminal 100, it may also 
be applicable that^irfea-i^t is informed to the distribution' 
server 200. In the case tte^Athe receiving bit rate RBR 
exceeds the upper limit bit rate UBR at the processing 1805, 
it isy^ di.aci - iminatG rd at (1808) whether or not tte/^mode of 
higher image bit .rate than that of the present one can be 
specified. If fete«J(mode can be specified, ttce^mode higher 
than the present image bit rate CBR is set at the request 
command (1809) and transferred to the processing 1801 in 
order to transmit it to the distribution server 200. In the 
cas^jl^SS^ mode cannot be specified, -fefee error processing 
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is carried out (1810) . An example of the error processing 
is to display a message at the monitor of the receiving 



terminal lOOj^that the image bit rate switching cannot be, 
executed and the like. However, in this case, the error 
5 processing operation can be skipped because the receiving 
bit rate is in an ascending direction. In the case l5iiacfej|the 
receiving bit rate RBR is lower than the -lower limit bit rate 



BBR at the processing 1806, it is^dissiimiiui I. il at (1811) 
whether or not ttramode of tteei lower image bit rate than the 
present one can be specified. In the case^tfe nt -h h r modes can 
be specified, tfeey^lower mode than that of the present image 
bit rate CBR is set at the request command (1812) , and it 
is transferred to the processing 1801 in order ^ to^r an|m^ 
it to the distribution server 200. In the case tfeaF*^fete« mode 
cannot be specified, ^feise. error processing is carried out 
(1813). An example of the error processing is to display 
a message at the monitor of the receiving terminal lOO^that 
Isise- imaqe bit rate switching cannot be executed and the like . 

Fig. 19 is a flow-chart showing ^an °rdor of receiving 
bit rate control under application of -yse^ascending 
switching sensitivity and -fete©^ descending switching 
sensitivity at the receiving terminal 100. 

Ml . 

At first, a=^counter (uc) for storing a^c ontmuous 
ascending time of the receiving bit rate and -y^counter (dc) 
for storing a continuous descending time of the receiving 



bit rate are reset to 0 (1901).. Next, the ascending 
switching sensitivity uc-.sinsi and the descending switching 
sensitivity dc-sinsi are set (1902) . In the example; in this 
figure,, both sensitivities . are set to 3. Subsequently, a 
moden of the required image data is set at the distribution 
server 200 (1903) . The image bit rate CBR is determined from 
the moden in reference to the image bit rate table 800 . Next, 
the image bit rate switching point table 900 is. referred to 
and the upper lim^it bit rate UBR and the lower limit bit rate 
BBR aire ag ^eOirCd ( 1 9 0 4 ) , and the distribution starting 
request command of the image bit rate CBR is transmitted to 
the distribution server 200 (1905) . Subsequently, it is 



A dliDGLniminatb el at (1906) whether or not the streaming 
operation is finished/ and in ^the case fe6Stj(the streaming 
operation is finished, the distribution stopping request 
command is transmitted to the distribution server to finish 
the processing (1825). In the case ^tfe^ the streaming 
operation is continued^the receiving bit rate ^^^j; ^^ 
measured (1907) to oom^S j^the upper limit bit rate UBI^with 
the lower limit bit rate BBR (1908, 1909) . If the receiving 
bit rate RBR is in. a range between the upper limit bit rate 
UBR and the lower limit bit rate BBR, the present mode is 
maintained (1910) . In the case fete^the receiving bit rate 
RBR at the processing^ 1908 exceeds the upper limit bi^rate 
UBR, it i s |^4^^e^4 Snated at (1911) whether or not trfse^mode 



of fefee^higher image bit rate t^^anthe present one can be 
specified. In the case . fehat the^ mode cannot be specified, 
ttpe error processing is carried out (1916) and the 
continuous ascending time counter^uc) is rest to 0 (1917) . 
5 An example of error processing is"s|,displaYlt<ftil of a message 
at the monitor of the receiving terminal 100 saying thatithe 
image bit rate awitching to the upper level mode cannot be 
executed. However, in this case, it may also be applicable 
that the error processing can be skipped because the 
10 receivinqj bit rate is in an ascending di rect ion. In the case 
that thiii^ ^mode can be specified, it ij ^diooriminatgd at (1912) 
whether or not a result of comparison between the receiving 
bit rate RBR and the upper limit bit rate UBR is the same 
as the previous result of comparison. If the result of 
15 comparison is different, the continuous ascending time 
counter (uc) is reset to 0 (1917) . If the result of 
comparison is the same the continuous ascend ing time 
counter (uc) ^is;, ^ddad' to 1 (1914)^. and it is;^d±g ^iffl4nated 
at (1914) whether or not the ascending switching sensitivity 
20 uc-sinsi and the continuous ascending time counter (uc) are 
equal to each other. In the casej^-fefespfe they are not equal 
to each other, the operation is transferred to the 
processing 1906 and returns to a normal processing loop. In 
the case fefes^they are equal to each other, =aa:^higher mode 
25 than that of the present image bit rate CBR is set to a 



request command (19i5) and it is transferred to the . 
processing 19^[to be transmitted to the distribution server 
200. In the case tefa^jthe receiving bit rate RBR xs lower 
than the lower limit bit rate BBR at the processing 1909 , 
it is^^TCiiminKi^ at (1918) whether ox not "fefee^ mode of ^ 
.. lower image bit rate than the present value can be specified. 
If %tet,mode cannot be specified, ti» error processing is 
carried out (1923), and the continuous descending time 
counter (dc) is reset to 0 (1924) . An example of the error 
process in'^displayfcj^a message at the monitor of the 
receiving terminal 100 saying that the image bit rate 
switching to the lower level mode cannot be executed In 
the cas e thait tKoj ymode can be specified, it is^axuuJ.imj.ajl.r H 
at (1919) whether or not a result of comparison between the 
receiving bit rate RBR and the upper limit bit rate BBR is 
the same as the previous result of comparison. If the result 
of comparison is different, the continuous descending time 
counter (dc) is reset to 0 (1924). If the result of 
comparison is the same, 1 is added to the 
> descending time counter (dc) (1920)^ and it is diccriminatPrl 
at (1921) whether or not the descending switching 
sensitivity dc-sinsi and the continuous descendi ng^i me 
counter (dc) are equal to each other. In the case0i^ they 
are not equal to each other, the operation is transferred 
5 to the processing 1906 and returns to a normal processing 
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loop. In the case^titsFfe they are equal to each other, 
lower mode than that of the present image bit rate CBR is 
set to a request command (1922) and it is transferred to the 
processing 1904^to be transmitted to the distribution server 
5 200. 

Fig. 20 is a flow-chart indicating a procedure for 
measuring the receiving bit rate at the receiving terminal 
100. 

At first, the monitoring trigger time is read out of 
10 the received fragment "uuid" (2000) and set to the 

monitoring trigger control unit 109 (2001). In the example 
shown in the figure, the monitoring trigger time is defined 
as TRGT The reference timer time is compared with the 
monitoring tagger time TRGT^and -i^^-^^^^i^until they ^ 
15 coincidet ^ach other (2002). When they coincide| *&^il£i3 

each other, the reference timer time TS at this time is read 
out (2003) . A i L-uul. in ig^of^w fragment is started from the 
time TRGT. At this time, ^Afragment size FSIZE is re^ out 
(2004) of the header of the fragment. Subsequently, #;data 
20 size of the fragment being received is counted (2005) and 
this is repeated until the counted value reaches FSIZE 
(2006) . When the counted value reaches FSIZE and the 
^B^^^^ of the fragment is completed, the reference timer 
time TE at that time is read out (2007). Lastly, the 
25 receiving bit rate RBR is calculated (2008) . The receiving 
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bit rate RBR is a value, in which the fragment size FSIZE is 
divided by the time (TE-TS) required for^receiving 
operation. The method shown in Fig. 20 can hold only a period 
in which the data being burst transferred ^ reache# a*: the 

5 receiving terminal 100 . Thus , Measurement accuracy of the 
receiving bit rate can be improved and an accurate image bit 
rate switching control can be performed because no 
measurement is carried out ais© at a time other than the 
burst transferring period y&^^fthe data is not reached^as 
10 compared with a technology for measuring a predetermined 
time, for example. 

A method fee^monitoring the received state for use in 
requesting, an image bit rate switching at the receiving 
terminal 100 is not limited to the aforesaid method , but may 
15 be carried out by another method. For example, as already 

boan described| ^lii Lhu duL \ . \ iiM i Fig. 5, either the 

header unit of the fragment or the re-distribution planned 
time for the data unit on the moving image and audio may be 
stored as the monitoring trigger information. Further, as 
20 a still further embodiment, in the case the 

distribution server 200 and the receiving terminal 100 store 
a transmitter having the same clock, a clock counter value 
planned to be distributed may be stored as the monitoring 
trigger information in place of the time information. The 
25 clock counter value may be an accumulated clock value from 



the starting time or a relative clock value from the previous 
fragment distributing operation. ^ iL ju/<A/<jbs^ 

Fig. 21 shows one example of an applied form^in which 
the deliver server 200 of the present invention and the 



receiving terminal 100 are^^ appl 'g -od . 

3s. 

This figure shows an examp^^of/conf iggra^on in which 
-te the distribution server 2100"][3^ connecte^JJa TV receiver 
set 2101 for receiving a TV broadcastili^ , an external public 
network 2103^such as aw^ internet or the like, an image memory 
device 2102 for use in recording image data inputted from 



the external public network 2103 and image datajt^ ^aving a TV 

program received by the TV receiver ^;|L|- ^/^^ ^ ^°f ^-|^|^ 

a predetermi^ed^convertj^pmethod, a^ itransmittor rrontn r A 



(2103) and a^ iansmlLLei center B (2104) to be connected to 
15 some mobile terminals^ such as a notebook type PC, PDA and 
mobile phone and the likejthrough^radio network. The image 
data taken from the external public network 2103 or the TV 
receiver set 2101 is distributed iaaj^a real time basis in 
response to a request from the mobile terminals. In 

20 addition , it may also be applicable that the image data taken 
from the external public network 2103 or the TV receiver set 
2101 is as^S/^ccumulated at the image memory device 2102^and 
the image data is properly distributed in response to the 
request from the mobile terminals^ .The di strib uting 

25 operation passing through the fei.- anamT^;tGr ^ontrrx t i (2103) 



is an example in which ^ase-. mobile terminals^ such as, the 
notebook type PC (2110.) , PDA (2109) and mobile phone 2108 j 
or the likejdirectly receive image data,j ^soo ana ftoar them . 
In the ease of distributing through the transmitte r ^ cen ter 
5 B (2104) , the image data passes through the relayj^^ aontur A 
(2105) , the radio public network 2106 and the relay center 
B (2107) and the image data is received at the mobile 
terminals (2111, 2112, 2113) . In addition, in the case of 
the distribution f or outputting image data directly from the 
10 distribution server to the radio p ublic network 2106, the 
image data passes through the relay^ oant i ti: B (2107) , and the 
image^d^^^J^s^^ceived at the mobile terminals (2111, 2112 , 
2113) ,j^seen and heard tharo . At each of the distributing 
paths, the image data may also be distributed through a 
15 plurality of transmitter centers, relay centers and radio 

line networks. ^^..^ofe v 

Fig. 22 shows an example of a typical applied form„ 
using the distribution server 200 and the receiving terminal 
100 of the present invention. 
20 &rjrrTba^ggg;^of the image data is carried out such 

that the image data is transmitted from the distribution 
server 2201 in response to a request from the receiving 
terminal 100, the image data passes through the radio public 
network 2203 and the relay center 2202 and reaches the 
25 receiving terminal 100 acting as a requesting unit. 



} 



The a^uL'&'jaid description up to now has been a«efe==»««h^»^£ii==^ 
fefcpfe- the image bit rate switching operation|respbnding to 
the request of the receiving terminal lOOjis executed at the 
distribution server 2201. However, the image bit rate 
switching operation may also be carried out at the relay 
center 2202. With this operation, the relay center 2202 is 
juLijIiuuLLTTily required to perform the image ^bit^^te ^ 
switching control operation, resulting in ^aact ^processing 
load at the distribution side ia^^s^a-od. Additionally, the 
receiving terminal lOO has an effect^that its response is 
improved as the switching operation is carried out. 

An example of|jCharging form for the image distributing 
system to which the method of the present invention has been 
applied may be applied to tfee^case in which a specified 
charge^ may be applied for every one image content 

irrespective of ;presence or non-presence of 
the image bit rate switching operation. In addition, the 
charging may be applied in response to eith^ the 
reproducing time (a distributir^time) or «nj( amount of 
distributed data irrespective ofj^presence or non-presence 
of the image bit rate switching operation. Further, the 
charging c^^with the content of the image bit rate 
switching operation may be applied under any charging 
conditions^such as the reproducing time (the distributing 
time) or the distributing data amount for every distribution 



of one image content and the like. For example, when the 

image bi_^^te is low, the charging in utilization is 

calculated j^low^ and when the image bi t^rat^g^ s high, the 

charging in utilization is calculated^isw . 

A specified charging for every image content 

dirtri hiiTTnrrt -p^^""^ ^ "^'^ ^ charging method associated with 

either the reproducing time or the ( E:^ti:ibut -arwg data amount 

• . .■■ ^ ■ ■ ■ 

or the like has some merit>/that the^ charging management can 

be easily performed at the ^ ^kTlbufc w ^/^side and the 

utilization charge can be easily understood by a customer. 

In turn, quality of the distributed image or audio attained 

through application of the image bit rate switching control 

is apt to show a low quality when the image bit rate is low, 

an'^^t to show a high quality when the image b i^ra^e^i s 

high. With this arrangement, the charging method Ita^'iwg^the 

content of the imaae bit rate switching operation^adjusted 



has a merit in^^^^a us^^ ^anjj nder stand the utilization 
charge because an^irapression^at the time of seeing or hearing 
reflects on the charging. 
20 Fig. 23 shows one example of a user-interface of the 

receiving terminal 100. ^ 

This figure shows an example ofJl^GUI (Graphical User 
Interface) displayed at the^onitor of febi^mobile terminal^ 
such as a PDA and the like. ^GUI is constituted by a moving 
25 image display frame 2309, a reproducing (an image 



distributing start request) button 2301, a stop (an image 
distributing stop request.) button 2302, a finish button^ 
2303, an automatic and manual switching button 2304 f or 
image bit rate, manual selection buttons for the image bit 
rate (2305, 2306, 2307) and an operating state display frame 
230-8 or the like. It may also be - ap j ^ll udl Tl that the GUI 
may have, in addition to the foregoing elements, another 
operating ^"^"^^^"^ display frame and the like as required. 
In the case tsfeat/^this system is actually installed in a 
mobile phone, these instruction buttons are arranged under 
an application of phone number input keys or menu keys or 
the like The receiving terminal 2300 receives information 
such as imag^rom the server through the antenna 2310 and 
displays it in sequence at the moving image display frame 
2309 I^j^^^tv^^ th " present invention causes the bit rate 
of this moving image to be controlled. The image bit rate 
switching control may be carried^ out automatically by ^^^^ 
receiving terminal 2300jandj^further manually switched by -a^ ^ 
user himself. For example, the image bit rate switching 
f control is changed over through a toggle between an 

automatic mode and a manual mode every time tl^uto/manual 
switch button 2304 is depressed. In the case o f^ manual mode , 
it may also be appJ.io Qte ^ that a user depresses the manual 
selection buttons (2305, 2306, 2307) corresponding to the 
5 type of the image bit rate to cause them to be switched. For 



example., in the case of service in which -febe-^charging fee a 
adjusted by the content of the image bit rate switching is 
applied to the utilization charge, the low image bit rate 
can be maintained continuously when it is desired to see or 
5 hear the image at a low charging fee. In addition, when an 
automatic switching control accompanied by a switching 
accuracy is being carried out, the automatic control is 
interrupted to enable the s w i t ch jmg^^ ^e^rj^^ n to be carried 
out under a user's preference a ga i rrst .^. qu a 1 i ty of the image 
10 even if the operation dogs not rea^^hj automatic switching 
condition. In general , y^impression/on seeing or hearing the 
moving image or audio sound shows a certain disturbance by 
individual users. A friendly user may^ac^r- f riondly agains t 
a slight variation in image quality and a sensitive user may 
15 be sensitive^jiTT^t^variation in image quality. Due to this 
fact, it is possible to applyAimpression that a manual 
switching rather than an automatic switching of the image, 
bit rate sometimes provides | more convenience in use. 
Also^in the case of image distributiog^under 
20 application of only a wired line-^such as a©-;^ internet , ^ 
variation in g^^d^ta transfer speed is generated under 



influence of tsirXSpplied state of the^^^^e . However, m 
general, the wired line hss f requently;^ a far wider data 
transfer area as compared with that of the radio line and 
the variation of the receiving bit rate at the terminal 



hardly produces a problem. In turn, it is p - raotioally 
difficulty to assure a wide data transfer area with the radio 
line in view of the restrictions on the international 
standards or limitations on performance of the 
communication de^ce or the like. Further, due to a 
characteristic ofj\ radio network, the device may easily be 
influenced by attenuation^^ reflection of the 
electromagnetic wave and j^surrounding environment^ andj 



additionally^ a variation in the data transferring speed 
frequently happens. As described above, the method f or 
image distributing operation of the present invent ion^-which 
has been described up to now. is particularly effective in 
the. case -fefe^fe^^it is applied to t±ce/image dist^^uting system 
using t;ti5^radio line where Iste^ variation injfcdata transfer 
speed may easily occur. 

It is also applicable that the distributed data 
handled by the image distribution apparatus of the present 
invention is $ data of moving image only or # data of audio 
sound only. In addition, =y»e data other t ^arT^j^ eji moving 
image or ^ug^io sound may also be applied. ^ Thooc data may 
be data for^Web (World Wide Web )^ such as still image data, 
text data, SGML (Standard Generalized Markup Language) or 
HTML (Hyper Text Markup Language) . 

As -fefee/^monitoring means separate from the method for 
monitoring the receiving bit rate, it may also be applicable 



that a residual amount of data at the memory unit 104 having 
the received data stored therein is monitored. The residual 
amount of data at the memory unit 104 is influenced by the. 
data-receiving throughput.. If the data receiving 
throughput is decreased, the residual amount of data is apt 
to be decreased. In turn, if the data-receiving throughput 
is increased, the residual amount of data is apt to be 
increased. In the case t-b**.; these states are monitored and 
the residual amount of data is lower than the predetermined 
amount r^tj^is switched to -fetee;^ image bit rate of flower level 
mode In addition, when the residual amount of data exceeds 
the predetermined amount, jst^is switched to tfe«^ image bit 
rate of ^tapper level mode. 

This method enables the monitoring operation to be 
executed on an extension of a data reading-out operation 
^^^^he reproduction unit at the receiving terminal reads 
outj^d it can be installed while aj^processmg amount of the 
monitoring operation is reduced. 

In the case tstesp^ the image data to be received is 
changed into a cipher code as another monitoring means and 
■ the decoder 114 arranged in the reproducing unit 105 



performs a decoding of the received data, it may also be 
applicable that ar^frame rate for the decoding operation is 
monitored. The frame rate of the decoding is influenced by 
the data-receiving throughput. The frame rate of decoding 



is decreased because the frame to be reproduced does not . 
reach j^as planned if the data-receiving throughput is 
decreased. In turn, if the data-receiving throughput is 
improved, the reproducin^rame reaches^^fee value ra^^e^than 
a planned one, so that •»|frame rate of the decoding is 
improved. As a procedure for switching the receiving bit 
rate, the frame rate at the time of decoding, for example, 
is lower than the frame rate specified by the content, it 
is switched to the image bit rate of flower level mode. In 
addition, when it is lower than the frame rate specified by 
the content, it is switched to the image bit rate of^upper 
level mode. According to this method, a complex calculation 
is not needed in particular, and the number of frames per 
predetermined time is counted to enable the monitoring 
operation to be realized^^ soAit is possible to mount it 
with ^processing amount o^monitoring operation being set 
low . 

As a still further monitoring means, it may also be 
applicable that a time stamp included in the received image 
data IS monitored. The reference timer 108 of the receiving 
terminal 100 manages the time stamp. For example, 
STC (System Time Clock) of the MPEG system corresponds to 
it. The image data of MPEG contains information concerning 
the reproduction timejsuch as SCR (System Clock Re^rence) , 
PTS (Presentation Time Stamp) and the like-^SCR^is meant 
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byasHytime bccomin-gKa reference of the reproducing time. At 

the receiving terminal 100 , the reference time is set to STC, 
i.e. the reference timer 108 at the time of receiving SCR. 
PTS is I t|^me information added fo^very image 
data^andjis used for controlling «^timing^eproducing the 
decoded frame. The decode image is displayed at the time 
of decoding a certain frame when the value of PTS of the. frame 
^ coincide^with the value of STC. Also^at the reproducing 
time management using PTS, it is influenced under the 
data-receiving throughput. Ai\^Mx 

When the data-receiving throughput is decreased yy PTS 
does not corr^pond to ^CT S^i^ ause its decoding is also 
delayed, and »^difference S^time information is increased 
in a negative direction. In turn, if ^h^ data-receiving 
throughput is improved, the difference Qr€j|time information 
is increased in a positive direction because a frg^waiting 
for the reproduction is added. In the ""^^J^^^^^^^ 
relations are mpnitored and a difference bSweenj^STt and PTS 
at the time of ^decoding operation 
) time difference in a negative direction, :^is switched to 
fete^mage bit rate^f jlower level mode. In addition, when 
the difference bef^Ti^^T^ and PTS exceeds more ^^an a^ ^^^^^^ 
predetermined time difference in a positive direction ,^it 
is switched to an image bit rate of an upper level mode. 



) 



It is possible to get an accurate delay time when a . • 
data receiving operation is performed because this method 
checks'^ime information included in the image data. With 
this operation, it becomes possible to feed-back an accurate 
starting time -a^^^t^ a reproduction starting operatxon 
after the. image bit rate switching. 

AlHthe methods for monitoring the receiving bit rates 
described above T^SS5S?e a monitoring operation |;^SS9t 
monitoring trigger information sent from the distribution 
server for a predetermined period from | trigger information 
included in the monitoring trigger information sent from the 
distribution server. 

According to the present invention, it becomes 
possible to provide an image distribution system using a 
radio line where a data transfer speed easily 
occur, wherein the receiving termin^^tself j^^-uJ u rUliULluii 
to perform an accurate monitoring of j^receiving bit rate at 
the time o^^nage streaming operation and a switching to the 
most-suitable image bit ^e is requested to ^^^^J^^^^^jJ- 
response to the result of j^monitoring operation ,^rL.uulting 
^ that it becomes possible to provide means capable of 
executing a stable image streaming operation. 



